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This  grant  supported  empirical  research  and  development  of  dynamical  models  of  memory 
retrieval.  In  this  period  this  subject  was  explored  primarily  in  seven  related  domains:  1)  the  evolution 
of  the  interaction  of  storage  and  retrieval  of  event  memories  and  knowledge;  2)  the  rapid  dynamics  of 
the  way  task  evidence  changes  as  perception  and  retrieval  occur  from  both  knowledge  and  event 
memories;  3)  the  dynamical  process  of  decision  making  in  short-term  recognition  memory;  4)  short 
term  memory  for  attributes  of  visual  stimuli  presented  simultaneously;  5)  the  process  of 
accumulating  evidence  about  associations  across  trials  when  individual  trials  are  each  ambiguous;  6) 
how  memory  retrieval  is  harmed  by  the  act  of  storing  information  during  testing;  7)  how  seemingly 
irrational  decision  making  can  be  interpreted  in  terms  of  humans  knowledge  of  probability  being 
rooted  in  quantum  probability  theory. 

The  first  project  had  results  summarized  in  a  publication  in  our  field's  major  theoretical 
journal:  Nelson,  A.  B.  and  Shiffrin,  R.M.  (2013).  The  co-evolution  of  knowledge  and  event  memory. 
Psychological  Review,  120(2);  356-394.  We  reported  a  general  model  for  the  dynamic  interaction  of  event 
memory  and  knowledge,  based  on  several  studies  in  which  knowledge  for  novel  (Chinese)  characters  was 
developed  through  extensive  training.  The  interaction  of  this  knowledge  with  event  memory  was  assessed  with 
a  knowledge  task  (pseudo-lexical  decision),  a  perceptual  task  (perceptual  identification),  and  an  episodic 
recognition  task  (recognition  memory  for  occurrence  of  a  test  item  on  a  studied  list).  This  research  represented 
a  major  advance  because  event  memory  and  knowledge  memory  are  usually  treated  independently.  The 
essence  of  the  model  explained  how  knowledge  evolves  through  repeated  exposure  to  sufficiently  similar 
events  (consisting  of  content  and  context):  The  events  are  stored  individually,  but  also  accumulate  in  a  separate 
trace  we  call  knowledge  (containing  accumulated  content  and  context).  When  any  event  later  occurs,  it  consists 
of  stimuli  and  context.  The  stimuli  get  processed  by  access  to  knowledge  based  on  similarity  of  test  probe  to 
traces  in  knowledge-  the  features  in  the  knowledge  trace  gradually  are  perceived  and  are  placed  in  short-term 
memory  as  a  continually  changing  and  growing  probe.  This  probe  in  turn  is  used  to  retrieve  additional 
information  in  knowledge,  and  also  information  from  similar  event  traces.  The  model,  termed  SARKAE, 
specifies  the  time  course  of  these  interacting  processes,  and  shows  how  they  explain  perception,  knowledge 
retrieval,  event  retrieval  and  retrieval  of  associations  of  both  types,  modeling  in  detail  both  accuracy  and 
response  time  data. 

The  second  project  is  represented  by  the  thesis  of  my  PhD  student,  Greg  Cox,  and  by  our  earlier  paper 
Cox,  G.  E.,  &  Shiffrin,  R.  M.  (2012).  Criterion  setting  and  the  dynamics  of  recognition  memory.  Topics  in 
Cognitive  Science,  4(1),  135-150.  The  thesis  is  presently  in  the  process  of  certification  at  IU  (although 
Greg  is  now  on  a  'postdoctoral'  research  appointment  at  Syracuse  University)  and  is  now  being 
prepared  for  journal  submission.  This  research  involved  production  of  a  dynamic  model  for  memory 
storage  and  particularly  retrieval,  a  model  capable  of  explaining  event  memory  measured  by  accuracy 
and  response  time,  and  for  a  variety  of  tasks  including  recognition  memory,  with  and  without  speed 
stress  and  speed  cutoffs,  and  memory  for  associations.  Most  prior  models  for  event  memory  that  have 
been  used  to  predict  accuracy  and  response  time  jointly  have  dissociated  the  process  of  evidence 
collection  and  decision  making  from  the  processes  of  perception  and  memory  access.  Thus  accuracy 
and  response  time  are  the  result  of  a  diffusion  or  random  walk  that  moves  at  a  constant  drift  rate  to 
one  or  more  response  barriers.  The  present  dynamic  model  changes  the  rate  of  evidence  collection 
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moment  by  moment  as  different  types  of  features  are  extracted  from  the  environment,  from  our 
stored  knowledge  and  from  event  memories.  The  model  explains  previously  known  but  largely 
ignored  results,  and  new  results  collected  in  our  laboratory,  concerning  the  effects  of  priming,  word 
frequency  in  event  recognition,  effects  of  speed  vs  accuracy  instructions,  the  effects  of  changing  test 
stimuli  dynamically  over  brief  periods  of  time  so  that  the  changes  are  not  perceived  consciously,  the 
effects  seen  when  the  time  of  response  is  governed  by  a  signal  to  respond,  the  effects  of  study  time, 
list  length  and  list  strength,  and  the  differences  between  memory  for  items  and  the  memory  for 
associations  between  items.  The  last  of  these  phenomena  is  based  on  the  idea  that  item  features  are 
collected  first  and  associative  features  collected  later  in  time.  This  modeling  should  represent  a  major 
change  and  advance  in  the  way  we  understand  the  processes  of  memory  retrieval. 


The  third  line  of  research  involves  empirical  studies  and  modeling  of  short-term  recognition 
memory,  a  line  of  research  famously  modeled  by  Saul  Sternberg  in  the  1960s  as  based  on  serial 
exhaustive  scanning.  Our  recent  research  reveals  that  the  pattern  of  data  originally  collected  was  due 
to  extra  time  between  study  of  a  list  of  items  and  the  recognition  test  item,  extra  time  allowing  the  list 
items  to  be  rehearsed  in  various  ways.  Our  research  uses  a  paradigm  in  which  the  test  item 
immediately  follows  the  study  list:  the  data  pattern  changes,  and  the  underlying  processes  are 
clarified.  The  data  now  show  strong  effects  of  lag  (recency),  and  we  have  used  and  tested  extensively 
a  dynamic  model  that  explains  the  accuracy  and  response  time  data.  The  results  are  reported  in 
"Nosofsky,  R.  M.,  Cao,  R.,  Cox,  G.  E.,  &  Shiffrin  R.  M.  (2014a).  Familiarity  and  categorization  processes 
in  memory  search.  Cognitive  Psychology,  75,  97-129",  and  "Nosofsky,  R.M.,  Cox,  G.E.,  Cao,  R.,  & 

Shiffrin,  R.M.  (2014b).  An  exemplar-familiarity  model  predicts  short-  term  and  long-term  probe 
recognition  across  diverse  forms  of  memory  search.  Journal  of  Experimental  Psychology:  Learning, 
Memory  and  Cognition,  40(6),  1524-1539". 

The  fourth  line  of  research  examines  memory  and  precision  of  memory  for  attributes  of  visual 
stimuli  presented  simultaneously.  A  debate  has  been  going  on  for  some  time  concerning  the  issue  of 
all-or-none  forgetting  of  the  presented  visual  objects.  One  class  of  models  proposes  all-or-none  loss 
and  guessing  when  the  lost  item  is  probed,  and  another  class  proposes  gradual  loss  of  information  for 
all  items  in  the  visual  display.  Using  both  accuracy  and  response  time  measures,  and  careful 
quantitative  modeling,  we  have  been  able  to  demonstrate  convincingly  that  all-or-none  loss  coupled 
with  guessing  provides  the  best  account  of  short-term  loss  of  visual  memory.  The  papers  are: 

"Donkin,  C.,  Nosofsky,  R.,  Gold,  ].,  and  Shiffrin,  R.  M.  (2013).  Discrete-slots  models  of  visual  working- 
memory  response  times.  Psychological  Review,  120(4),  873-902",  and  "Donkin,  C.,  Nosofsky,  R.,  Gold,  J., 
and  Shiffrin,  R.  M.  (2015).  Verbal  labeling,  gradual  decay,  and  sudden  death  in  visual  short-term 
memory.  Psychonomic  Bulletin  and  Review,  22, 170-178." 


The  fifth  line  of  research  data  concerns  statistical  learning.  Several  stimuli  (auditory  and 
visual)  are  presented  together  on  each  trial.  There  is  a  one  to  one  mapping  of  sound  to  vision,  but  the 
correct  associations  on  each  trial  are  ambiguous.  Over  several  trials  using  the  same  mappings,  the 
correct  associations  become  evident  through  statistical  accumulation.  This  line  of  research  explores 
the  type  of  learning  we  almost  always  encounter  during  development,  such  as  the  correct  word  to 
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object  mappings  in  language  learning.  Our  research  has  explored  the  mechanisms  of  statistical 
learning  and  allowed  us  develop  a  model  that  explains  in  detail  the  interacting  processes  that  allow 
statistical  learning  to  occur.  Much  of  this  research  is  due  to  my  PhD  student  George  Kachergis  (whose 
PhD  thesis  won  a  Glushko  prize  for  best  dissertation)  and  my  colleague  Chen  Yu.  The  model  uses  two 
primary  and  interacting  processes.  It  assumes  that  learners  do  not  attend  equally  to  all  possible 
word-object  pairings  and  store  all  co-occurrences.  Rather,  selective  storage  is  guided  by  several 
factors:  attention  is  given  to  pairings  on  the  current  trial,  and  particularly  those  that  are  familiar  from 
previous  co-occurrence.  However,  this  factor  is  in  competition  with  selective  attention  directed 
toward  stimuli  not  already  known.  The  papers  are:  "  Kachergis,  G.  (2012).  Learning  Nouns  with 
Domain-General  Associative  Learning  Mechanisms.  In  N.  Miyake,  D.  Peebles,  &  R.  P.  Cooper  (Eds.), 
Proceedings  of  the  34th  Annual  Conference  of  the  Cognitive  Science  Society  (pp.  533-538).  Austin,  TX: 
Cognitive  Science  Society.",  "Kachergis,  G.,  Yu,  C.  &  Shiffrin,  R.  M.  (2014).  Developing  semantic 
knowledge  through  crosssituational  learning.  Proceedings  of  the  36th  Annual  Conference  of  the 
Cognitive  Science  Society.",  "Kachergis,  G.,  Yu,  C.,  &  Shiffrin,  R.  M.  (2013).  Actively  Learning  Object 
Names  Across  Ambiguous  Situations.  Topics  in  Cognitive  Science,  5(1),  200-213.",  "Kachergis,  G.,  Yu, 
C.,  &  Shiffrin,  R.  M.  (2012a).  An  Associative  Model  of  Adaptive  Inference  for  Learning  Word-Referent 
Mappings.  Psychonomic  Bulletin  &  Review,  19(2),  317-324.",  "Kachergis,  G.,  Yu,  C.,  &  Shiffrin,  R.  M. 
(2012b).  Cross-situational  Word  Learning  is  Better  Modeled  by  Associations  than  Hypotheses.  IEEE 
Conference  on  Development  and  Learning  /  EpiRob  2012.  San  Diego,  CA:  IEEE.",  and  "Kachergis,  G., 
Yu,  C.,  &  Shiffrin,  R.  M.  (in  press).  A  bootstrapping  model  of  frequency  and  context  effects  in  word 
learning.  Cognitive  Science." 


The  sixth  project  examines  the  effects  of  testing  event  memory.  The  basic  idea  is  that  tests  of 
items  that  might  or  might  not  have  been  on  a  just  studied  list  are  also  events  that  are  stored  in 
memory.  Such  storage  produces  interference  by  the  usual  mechanisms  of  forgetting  based  on 
competition/interference.  The  result  is  a  continuous  degradation  of  event  memory  performance  as 
testing  continues  (note  that  performance  decreases  for  new  items  that  are  tested;  when  a  previously 
tested  item  is  tested  again,  of  course  performance  increases).  We  have  explored  and  modeled  this 
effect  in  several  experiments,  and  the  results  help  explain  the  processes  of  forgetting  of  events.  The 
papers  are:  "Criss,  A.  H.,  Malmberg,  K.J.,  &  Shiffrin,  R.M.  (2011).  Output  interference  in  recognition 
memory  testing.  Journal  of  Memory  and  Language,  64(4),  316-326.",  "Malmberg,  K. }.,  Criss,  A.  H., 
Gangwani,  T.  H.,  &  Shiffrin,  R.  M.  (2012).  Overcoming  the  negative  consequences  of  interference  that 
results  from  recognition  memory  testing.  Psychological  Science,  23(2),  115-119.",  "Annis,  J., 

Malmberg,  K.  J.,  Criss,  A.  H.,  and  Shiffrin,  R.  M.  (2013).  Sources  of  interference  in  recognition  testing. 
Journal  of  Experimental  Psychology:  Learning,  Memory,  and  Cognition,  39, 1365-1376.”  "Malmberg, 
K.J.,  Lehman,  M.,  Annis,  J.,  Criss,  A.H.,  &  Shiffrin,  R.M.  (2014).  Consequences  of  testing  memory. 
Psychology  of  Learning  &  Motivation  -  Advances  in  Research  and  Theory,  61,  285-313." 

The  seventh  project  is  aimed  to  explain  seemingly  irrational  decision  making  by  humans  by 
proposing  a  new  model  that  assumes  humans  understanding  of  probability  is  based  on  the  rules  of 
quantum  probability  rather  than  traditional  probability.  The  most  astounding  result  of  those  reported 
was  published  in  PNAS-it  tested  a  prediction  derived  from  the  quantum  probability  model  that 
applies  universally  and  without  parameters.  The  prediction  involved  the  effects  of  changing  the  order 
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of  two  binary  questions  asked  in  succession.  The  order  changes  the  results,  of  course,  but  the 
quantum  theory  predicted  a  particular  relation  for  the  changes  that  no  one  had  previously  noticed. 
Once  the  prediction  was  derived  we  looked  back  at  the  roughly  75  national  surveys,  starting  about 
1990,  carried  out  by  Gallup  and  Pew  that  had  this  manipulation.  The  prediction  held  in  every  such 
survey  (and  in  two  laboratory  studies  we  carried  out  as  an  additional  test).  In  addition  we  note  that 
thus  far  no  one  has  been  able  to  find  a  traditional  probability  theory  that  can  explain  these  findings, 
though  even  should  one  be  found  the  a  priori  universal  prediction  that  was  confirmed  in  past  data 
provides  a  good  deal  of  support  for  the  theory.  We  also  carried  out  other  studies  of  the  quantum 
theory,  and  thus  far  it  holds  up  as  a  viable  account  of  human  understanding  of  probability  and  the 
way  that  understanding  governs  decision  making.  The  papers  are:  "Pothos,  E.  M.,  Shiffrin,  R.  M.,  & 
Busemeyer,  J.  R.  (2014).  The  dynamics  of  decision  making  when  probabilities  are  vaguely  specified. 
Journal  of  Mathematical  Psychology,  59,  6-17. ",  "Wang,  Z.,  Soloway,  T.,  Shiffrin,  R.  M.,  &  Busmeyer,  J.  R. 
(2014).  Context  effects  produced  by  question  orders  reveal  quantum  nature  of  human  judgments. 
Proceedings  of  the  National  Academy  of  Sciences,  111(26),  9431-9436.",  "Busemeyer,  J.  R.,  Zheng,  W.,  & 
Shiffrin,  R.  M.  (2015).  Bayesian  model  comparison  favors  quantum  over  standard  decision  theory 
account  of  dynamic  inconsistency.  Decision,  2, 1-12. " 

Although  the  above  projects  are  the  main  ones  bearing  on  the  project,  there  were  several 
others  that  have  a  less  direct  but  nonetheless  relevant  connection,  in  areas  such  as  attention  and 
memory . I  just  list  these  here  without  commentary:  "Denton,  S.  E.,  and  Shiffrin,  R.M.  (2013).  Short¬ 

term  visual  priming  across  eye  movements.  In  C.  Chubb,  B.  Dosher,  Z.-L.  Lu,  &  R.  Shiffrin  (Eds.), 

Human  Information  Processing:  Vision,  Memory,  Attention.  American  Psychological  Association, 
Washington  DC.",  "Shiffrin,  R.  M.  (2013).  Memory.  In  Z.-L.  Lu  &  Y.  Luo.  (Eds.)  Progress  in  Cognitive 
Science:  From  Cellular  Mechanisms  to  Computational  Theories.  Peking  University  Press,  Beijing,  China 
(pgs  142-147).",  "Kumar,  K.  N.,  Chandramouli,  S.  H.,  &  Shiffrin,  R.  M.  (2015).  Salience,  perceptual 
dimensions,  and  the  diversion  of  attention.  American  Journal  of  Psychology,  128(2),  253-265.", 
"Hotaling,  J.  M.,  Cohen,  A.  L.,  Shiffrin,  R.  M.,  &  Busemeyer,  J.  R.  (2015).  The  dilution  effect  and 
information  integration  in  perceptual  decision  making.  PLoS  ONE,  10(9),  1-19.",  "Shiffrin,  R.  M.,  & 
Chandramouli,  S.  H.  (in  press).  Model  selection,  data  distributions,  and  reproducibility.  In  H. 
Atmanspacher  and  S.  Maasen  (Eds.)  Reproducibility:  Principles,  Problems,  and  Practices.  John  Wiley, 
New  York.". 
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Abstract 

There  were  four  major  areas  of  accomplishment,  and  several  important  but  subsidiary  ones.  The  first  two 

were  closely  related.  The  first  was  represented  by  the  publication  in  Psychological  Review  of  the  paper 

reporting  research  supported  by  the  grant,  titled: "  The  co-evolution  of  knowledge  and  event  memory".  The 

second  is  represented  in  the  thesis  by  my  PhD  student  Greg  Cox  titled: "  Dynamic  modeling  of  memory 

storage  and  retrieval".  This  research  is  now  being  prepared  for  submission  to  Psychological  Review.  The 

first  represents  a  general  model  for  the  dynamic  interaction  of  event  memory  and  knowledge,  based  on 

several  studies  in  which  knowledge  for  novel  (Chinese)  characters  was  developed  through  extensive 

training.  The  interaction  of  this  knowledge  with  event  memory  was  assessed  with  a  knowledge  task 

(pseudo-lexical  decision),  a  perceptual  task  (perceptual  identification),  and  an  episodic  recognition  task 

(recognition  memory  for  occurrence  of  a  test  item  on  a  studied  list).  This  research  represented  a  major 

advance  because  event  memory  and  knowledge  memory  are  usually  treated  independently.  The  second 

major  contribution,  thus  far  represented  by  the  thesis  and  the  publications  titled  "Criterion  setting  and  the 

dynamics  of  recognition  memory",  involved  production  of  a  dynamic  model  for  accuracy  and  response  time 

by  which  evidence  relevant  for  event  memory  judgment  is  collected  moment  by  moment,  changing  as 

different  features  are  extracted  from  the  test  item  and  knowledge  memory.  The  results,  based  both  on  free 

response  tasks  and  time  limited  response  tasks,  provide  important  insights  into  the  time  course  of,  and  the 
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effects  of,  study  time,  natural  language  word  frequency,  list  length  and  strength,  associative  memory, 
recognition  memory,  and  recall.  The  third  area  of  accomplishment  is  new  data  supporting  development  of  a 
new  dynamic  model  of  short-term  recognition  memory  explaining  lag  effects,  trial-to-trial  effects,  list  length 
effects,  and  use  of  knowledge,  for  both  accuracy  and  response  time  measures.  The  fourth  major  area  of 
accomplishment  is  data  and  modeling  of  statistical  learning,  by  which  responding  correctly  concerning  the 
pairings  of  stimuli  becomes  increasingly  accurate  as  information  is  accumulated  over  trials,  although  each 
trial  is  ambiguous.  Other  supported  research  examined  recognition  decision  making  based  on  mouse 
tracking  measurements  using  Gaussian  process  regression,  the  negative  effects  of  testing  caused  by 
memory  for  earlier  test  items,  the  dynamics  of  attention  and  perception,  and  several  papers  supporting  a 
quantum  probability  model  for  human  decision  making. 
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